Musical gestures and embodied cognition

In this keynote, musical gestures will be discussed in relation to the basic concepts of the embodied music cognition paradigm. Video examples are given of stud- ies and applications that are based on these concepts.

Alignment strategies for the entrainment of music and movement rhythms

Theories of entrainment assume that spontaneous entrainment emerges from dynamic laws that operate via mediators on interactions, whereby entrainment is facilitated if certain conditions are fulfilled. In this study, we show that mediators can be built that affect the entrainment of human locomotion to music. More specifically, we built D-Jogger, a music player that functions as a mediator between music and locomotion rhythms. The D-Jogger makes it possible to manipulate the timing differences between salient moments of the rhythms (beats and footfalls) through the manipulation of the musical period and phase, which affect the condition in which entrainment functions. We conducted several experiments to explore different strategies for manipulating the entrainment of locomotion and music. The results of these experiments showed that spontaneous entrainment can be manipulated, thereby suggesting different strategies on how to embark. The findings furthermore suggest a distinction among different modalities of entrainment: finding the beat (the most difficult part of entrainment), keeping the beat (easier, as a temporal scheme has been established), and being in phase (no entrainment is needed because the music is always adapted to the human rhythm). This study points to a new avenue of research on entrainment and opens new perspectives for the neuroscience of music

Using fuzzy logic to handle the semantic descriptions of music in a content-based retrieval system

This paper explores the potential use of fuzzy logic for semantic music recommendation. We show that a set of affective/emotive, structural and kinaesthetic descriptors can be used to formulate a query which allows the retrieval of intended music. A semantic music recommendation system was built, based on an elaborate study of potential users and an analysis of the semantic descriptors that best characterize the user’s understanding of music. Significant relationships between expressive and structural semantic descriptions of music were found. Fuzzy logic was then applied to handle the quality ratings associated with the semantic descriptions. A working semantic music recommendation system was tested and evaluated. Real-world testing revealed high user satisfaction

Panako: a scalable acoustic fingerprinting system handling time-scale and pitch modification

In this paper a scalable granular acoustic fingerprinting system robust against time and pitch scale modification is presented. The aim of acoustic fingerprinting is to identify identical, or recognize similar, audio fragments in a large set using condensed representations of audio signals, i.e. fingerprints. A robust fingerprinting system generates similar fingerprints for perceptually similar audio signals. The new system, presented here, handles a variety of distortions well. It is designed to be robust against pitch shifting, time stretching and tempo changes, while remaining scalable. After a query, the system returns the start time in the reference audio, and the amount of pitch shift and tempo change that has been applied. The design of the system that offers this unique combination of features is the main contribution of this research. The fingerprint itself consists of a combination of key points in a Constant-Q spectrogram. The system is evaluated on commodity hardware using a freely available reference database with fingerprints of over 30.000 songs. The results show that the system responds quickly and reliably on queries, while handling time and pitch scale modifications of up to ten percent

Using fuzzy logic to handle the users' semantic descriptions in a music retrieval system

This paper provides an investigation of the potential application of fuzzy logic to semantic music recommendation. We show that a set of affective/emotive, structural and kinaesthetic descriptors can be used to formulate a query which allows the retrieval of intended music. A semantic music recommendation system was built, based on an elaborate study of potential users of music information retrieval systems. In this study analysis was made of the descriptors that best characterize the user's understanding of music. Significant relationships between expressive and structural descriptions of music were found. A straightforward fuzzy logic methodology was then applied to handle the quality ratings associated with the descriptions. Rigorous real-world testing of the semantic music recommendation system revealed high user satisfaction

Representation of Samba dance gestures, using a multi-modal analysis approach

In this paper we propose an approach for the representation of dance gestures in Samba dance. This representation is based on a video analysis of body movements, carried out from the viewpoint of the musical meter. Our method provides the periods, a measure of energy and a visual representation of periodic movement in dance. The method is applied to a limited universe of Samba dances and music, which is used to illustrate the usefulness of the approach

The spatiotemporal representation of dance and music gestures using topological gesture analysis (TGA)

SPATIOTEMPORAL GESTURES IN MUSIC AND DANCE HAVE been approached using both qualitative and quantitative research methods. Applying quantitative methods has offered new perspectives but imposed several constraints such as artificial metric systems, weak links with qualitative information, and incomplete accounts of variability. In this study, we tackle these problems using concepts from topology to analyze gestural relationships in space. The Topological Gesture Analysis (TGA) relies on the projection of musical cues onto gesture trajectories, which generates point clouds in a three-dimensional space. Point clouds can be interpreted as topologies equipped with musical qualities, which gives us an idea about the relationships between gesture, space, and music. Using this method, we investigate the relationships between musical meter, dance style, and expertise in two popular dances (samba and Charleston). The results show how musical meter is encoded in the dancer's space and how relevant information about styles and expertise can be revealed by means of simple topological relationships

Ergogenic effect of music during running performance

In running competitions portable music players and headphones are often banned. In some cases, runners have been disqualified after using such devices during competition. In this paper, it is discussed whether, aside from possible safety reasons, such competition regulations make sense and whether music can have an ergogenic effect on performance. Although a definitive conclusion on the regulation matter is not of our concern here, we review evidence of the fact that music is capable of enhancing performance in running and a range of different sports, predominantly for short duration exercise with low-to-medium intensity. The use of music players can be beneficial for training. However, it is reasonable to avoid these devices and headphones in case of championships for professional athletes